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recursive inner coder codes the interleaved data to produce 
inner coded data. The mapping element maps the i nn er coded 
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SERIAL TURBO TRELLIS CODED 
MODULATION USING A SERIALLY 
CONCATENATED CODER 

CROSS REFERENCE TO RELATED 5 

APPLICATIONS 

This application is a continuation of U.S. patent applica- 
tion Ser. No. 9/760,514, entitled “Serial Turbo Trellis Coded 
Modulation Using A Serially Concatenated Coder”, filed Jan. to 
11, 2001, (which is incorporated by reference herein in its 
entirety), which in turn claims the benefit of the U.S. Provi- 
sional Application No. 60/176,404, filed on Jan, 13, 2000. 

STATEMENT AS TO FEDERALLY-SPONSORED 15 

RESEARCH 

The invention described herein was made in the perfor- 
mance of work under a NASA contract, and is subject to the 
provision of Public Law 96-517 (U.S.C. 202) in which the 20 
Contractor has elected to retain title. 

BACKGROUND 

Properties of a channel affect the amount of data that can be 25 
handled by the channel. The so-called “Shannon limit” 
defines the theoretical limit of amount of data that a channel 
can carry. 

Different techniques have been used to increase the data 
rate that can be handled by a channel. “Near Shannon Limit 30 
Error-Correcting Coding and Decoding: Turbo Codes,” by 
Berrou et al. ICC, pp 1064-1070, (1993), described a new 
“turbo code” technique that has revolutionized the field of 
error correcting codes. 

Turbo codes have sufficient randomness to allow reliable 35 
communication over the channel at a high data rate near 
capacity. However, they still retain sufficient structure to 
allow practical encoding and decoding algorithms. Still, the 
technique for encoding and decoding turbo codes can be 
relatively complex. 40 

A standard turbo coder is shown in FIG. 1. A block of k 
information bits 100 is input directly to a first encoder 102. A 
k bit interleaver 110 also receives the k bits and interleaves 
them prior to applying them to a second encoder 104. The 
second encoder produces an output that has more bits than its 45 
input, that is, it is a coder with rate that is less than 1. The 
encoders 102, 104 are also typically recursive convolutional 
coders. 

Three different items are sent over the channel 150: the 
original k bits 100, first encoded bits 111, and second encoded 50 
bits 112. 

At the decoding end, two decoders are used: a first con- 
stituent decoder 160 and a second constituent decoder 162. 
Each receives both the original k bits, and one of the encoded 
portions 110,112. Each decoder sends likelihood estimates of 55 
the decoded bits to the other decoders. The estimates are used 
to decode the uncoded information bits as corrupted by the 
noisy channel. 

Turbo codes are effectively parallel concatenated codes 
with an encoder having two or more constituent coders joined 60 
through one or more interleavers. Input information bits feed 
the first encoder, are scrambled by the interleaver, and enter 
the second encoder. A code word is formed by a parallel 
concatenated code formed by the input bits to the first encoder 
followed by the parity check bits of both encoders. 65 

Trellis coded modulation is described in “Channel Coding 
with Multilevel Phase Signaling”, Ungerboeck, IEEE Trans 


2 

Inf.Th. Vol. IT-25, pp 55-67, January 1982. Trellis coded 
modulation can produce significant coding gains in certain 
circumstances. 

In some situations it may be desirable to have a very low bit 
error rate, e.g. less than 10 -9 . 

SUMMARY 

The present application combines a combination of trellis 
coded modulation with turbo codes, to obtain certain advan- 
tages of bandwidth and power efficiency from the trellis 
coded modulation, while also obtaining other advantages of 
the turbo codes. A specific embodiment combines serially 
concatenated coding for the inner coder with trellis codes on 
the outer coder. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects of the invention will be described 
in detail with reference to the accompanying drawings, 
wherein: 

FIG. 1 shows a block diagram of a prior art turbo coder; 

FIG. 2 shows a block diagram of inner coder for serially 
concatenated trellis coded modulation using a generic map- 
per; 

FIG. 3 shows a block diagram of an inner coder using 
two-dimensional M point mapping; 

FIG. 4 shows a coder using a mapping system that provides 
trellis coded modulation for QAM; 

FIG. 5 shows a trellis coded modulator which has an inner 
coder formed of a two state device; 

FIG. 6 shows a trellis coder with a four state trellis coded 
modulator; 

FIG. 7 shows an outer coder for use in the FIGS. 5 and 6 
embodiments; 

FIG. 8 shows an alternative embodiment using bit punc- 
turing; 

FIG. 9 shows a block diagram of an iterative decoder; 

FIG. 10 shows a trellis diagram for the decoder; and 

FIG. 1 1 shows a turbo coder with lower complexity. 

DETAILED DESCRIPTION 

A disclosed embodiment uses serially concatenated codes 
with Trellis codes, to obtain low error floors and obtain the 
advantages of iterative coding as it is often used in a parallel 
concatenated code. 

In a “classical” concatenated coding system, an interleaver 
is placed between inner and outer coders to separate bursts of 
errors produced by the inner encoder. In contrast, the serially 
concatenated coder described herein may optimize the inner 
and outer coders and the interleaver as a single entity thereby 
optimizing the whole serial structure. This has not been done 
in the past due to complexity and the difficulty of optimum 
coding. 

The present application may use the technology of the 
uniform interleaver as described in “unveiling turbo codes: 
some results on parallel concatenated coding schemes”, S. 
Benedetto, et al , IEEE TRANS of Inf Theory March 1996. 
The uniform interleaver allows setting criteria which opti- 
mize the component codes in order to construct more power- 
ful serially concatenated codes with a relatively large block 
size. 

The complexity of the coding is handled herewith using 
sub optimum iterative decoding methods. The concatenation 
of an outer convolutional code or a short block code with an 
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inner trellis coded modulation code is called a serially con- 
catenated TCM code. This system enables a relatively very 
low bit error rate. 

FIG. 2 shows the basic structure of the serially concat- 
enated trellis coded modulation scheme. The outer coder, 5 
which is a serial concatenated coder 200, receives input data 
202 having 2b bits, and produces output data 204 having 2b+l 
bits. Hence, the outer coder 200 has a rate 2b/(2b+l). More 
generally, however, the coder should have a rate somewhat 
less than one. A short block code can alternatively be used as to 
long as it has maximum free Hamming distance as the outer 
code. 

An interleaver n 21 0 permutes the output of the outer coder 
200. This produces interleaved data 212. The interleaved data 
212 enters an inner coding block 220 which is a recursive, 15 
convolutional inner coder having rate (2b+ 1 )/ (2b+2). Mapper 
230 then maps the 2b +2 output bits of the inner coder 220 to 
two symbols. Each symbol belongs to a 2 b+1 level modulation 
or four dimensional modulation. This system uses 2b infor- 
mation bits for each two modulation symbol intervals, 20 
thereby resulting in a b bit/second/Hz transmission when 
ideal Nyquist pulse shaping is used. In other words, this 
provides b bits per modulation symbol. The inner code and 
the mapping are jointly optimized based on maximum effec- 
tive free Euclidean distance of the inner trellis coded modu- 25 
lation, as described above. 

There are many different ways of configuring two-dimen- 
sional and multidimensional trellis coded modulators. Con- 
ventional trellis coded modulator designs may have draw- 
backs when used in this situation. Therefore, while the 30 
present application contemplates using conventional trellis 
coded modulators, it is noted that there are reasons why such 
conventional modulators may be less useful. 

In a serial trellis coded modulator, the Euclidean distance 
of encoded sequences can be very large for input sequences 35 
having a Hamming distance equal to one. This may not be 
satisfied even if the encoder structure has feedback. Some of 
the input bits may remain uncoded in a conventional trellis 
coded modulator. These uncoded bits may select a point from 
among a set that has been chosen according to the encoded 40 
bits. The combination of coded and uncoded bits is then 
mapped to either two or higher dimensional modulation. 

It has been considered by the present inventors to use 
conventional trellis coded modulation without parallel 
branches. This, however, may require that the number of 45 
states be greater than the number of transition per states. This 
in turn may prevent the use of simple codes with a small 
number of states. 

Conventional trellis coded modulators also assign the input 
labels effectively arbitrarily. It has been thought by many that 50 
the assignment of input labels did not play an important role 
in coding. According to the present specified coding system, 
input labels are carefully selected. 

Another aspect is the complexity of the code selection. The 
serially concatenated trellis coded modulation described with 55 
reference to FIG. 2 has a number of transitions per state of 
2 2b+1 . For specific case of interest, b may equal 3. Therefore, 
even if the number of states is low, the number of transitions 
may be high. For two states, there still may be 128 transitions 
per state, resulting in 256 edges in the trellis section. The 60 
complexity of the decoder may depend on the number of 
edges per trellis section. This complexity as described above 
may actually interfere with high-speed operation, since the 
complexity of operation takes time to complete. 

Another serial concatenated trellis coded modulation 65 
scheme is shown in FIG. 3. This system uses a two-dimen- 
sional constellation with M points. For purposes of explana- 
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tion, we can define m=log 2M, where M is the number of 
phases. In this structure, the input data 300 is coupled to an 
outer coder 310 producing b + 1 bits for the b input bits . Hence, 
the outer coder is a rate b/b+1 binary convolutional coder. An 
interleaver 320 permutes the output of the outer coder. The 
interleaved data enters a rate m/m 1 recursive convolutional 
inner coder. The m output bits are then mapped to one symbol 
along into a 2 m level modulation by a mapping element 340. 
This system uses b information bits per b+l/m modulation 
symbol interval. It effectively results in bm/b+1 bits per 
modulation symbol. 

The inner coder 330 and mapping 340 are jointly optimized 
based on maximization of the effective free Euclidean dis- 
tance of the inner trellis coded modulator. 

For example consider 8PSK modulation, where m=3. 
Then, the throughput r=3b/(b+l) is as follows: for b=2, r=2; 
for b=3, r=2.25; and for b=4, r=2.4. Accordingly, a Vi convo- 
lutional code with puncturing can be used to obtain various 
throughput values, without changing the inner coder modu- 
lation. 

For rectangular M 2 -QAM, where m=log 2 M, the structure 
may become even simpler. In this case, to achieve throughput 
of 2mb/(b+l) bps/Hz a rate b/(b+l) outer coder and a rate 
m/m inner coder may be used, where the m output bits are 
alternatively assigned to in-phase and quadrature compo- 
nents of the M 2 -QAM modulation. 

The structure of the SCTCM encoder is shown in FIG. 4. 
An outer coder 400 is comiected to an interleaver 410, which 
drives a trellis code modulator inner coder 420. 

For example consider 16-QAM modulation, where m=2, 
then the throughput r=4b/(b+l) is: for b=l, r=2; for b=2, 
i=2.67; for b=3, r=3; and for b=4, r=3.2. 

For this embodiment, b=r=3. This causes the number of 
transitions per state of the inner TCM 420 to be reduced to 4 . 
This results in a large reduction in complexity: 32 times lower 
than the previous case. Moreover, the outer coder also has a 
lower code rate; this code rate may be reduced from 6/7 to 3/4 . 

Other embodiments of this basic idea are also possible by 
changing the mapping. In the FIGS. 5 and 6 embodiments, the 
output of the inner coder is mapped to the I and Q components 
of 16QAM alternatively. The encoder structure of a SCTCM 
for 2-state inner TCM is shown in FIG. 5, which shows the 
rate 3 A four state coder 500 operating as the outer coder. An 
interleaver 510 drives the inner coder 520. 

The encoder structure of SCTCM for 4 -state inner TCM is 
shown in FIG. 6. The inner coder 620 includes two delay 
elements as shown. The outer coder 500 has an optimum rate 
3/4, 4-state nonrecursive convolutional code with free Ham- 
ming distance of 3. 

The detailed structure of the outer encoder 500 is shown in 
FIG. 7. This rate 3/4, 4-state outer code has 32 edges per trellis 
section and produces 4 output bits. Thus the complexity per 
output bit is 32/4=8. The complexity per input bit is 32/3. 

The complexity of the outer coder may be further reduced 
using a rate of 1/2, 4-state systematic recursive convolutional 
code. This code can be punctured to rate 3/4, by puncturing 
only the parity bits. The minimum distance of this punctured 
code is 3, the same as for the optimum code. Now the code has 
8 edges per trellis section and produces 2 output bits. Thus the 
complexity per output bit is 8/2=4. Since this code is system- 
atic there is no complexity associated with the input. The 
encoder structure for this low complexity SCTCM is shown in 
FIG. 8. 

Using this low complexity scheme with 5 iterations is 
roughly equal to the complexity of a standard Viterbi decoder. 
However, this obtains a 2 db advantage over the “Pragmatic” 
TCM system. 
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It can be shown that a dominant term in the transfer func- 
tion bound on bit error probability of serially concatenated 
TCM, employing an outer code with free (or minimum) Ham- 
ming distance d°, averaged overall possible interleavers of N 
bits, is proportional for large N to 5 

N 31 l(rf/+l)/2j e -& 2 (£3/4Ar 0 ) 

Where [xj represents, the integer part of x, and 


6 2 = f for d® even, and 

|?2= ( ^-3V/,# +(/| (3, ) 2 | (ord 0 odd 


The parameter d^^ the effective free Euclidean distance of 
the inner code, h OT ( ^ is the minimum Euclidean distance of 
inner code sequences generated by input sequences with 
Hamming distance 3, and E^ /N 0 is the M-ary symbol signal- 
to-noise-ratio. 

The above results are valid for very large N. On the other 
hand, for large values of the signal-to-noise ratio E/N 0 , the 
performance of SCTCM is dominated by 

N -(V*«)-1 ) e -h m 2 (E2/4N(j) 


20 


where h m is the minimum Euclidean distance of the SCTCM 
scheme, and l m (h m )^d / ?. 

Based on these results, the design criterion for serially 
concatenated TCM for larger interleavers and very low bit 30 
error rates is to maximize the free Hamming distance of the 
outer code (to achieve interleaving gain), and to maximize the 
effective free Euclidean distance of the inner TCM code. 

Let z be the binary input sequence to the inner TCM code, 
and x(z) be the corresponding inner TCM encoder output with 35 
M-ary symbols. The present application defines criteria for 
selecting the constituent inner TCM encoder: 

1 . The consituent inner TCM encoder may be configured 
for a given two or multidimensional modulation such that the 
minimum Euclidean distance d(x(z), x(z')) over all z, z' pairs, 40 
z^z' is maximized given that the Hamming distance d^z, 
z')=2. We call this minimum Euclidean distance the effective 
free Euclidean distance of the inner TCM code, d f ^. 

2. If the free distance of outer code dy° is odd, then, among 
the selected inner TCM encoders, choose those that have the 45 
maximum Euclidean distance d(x(z), x(z')) over all z, z' pairs, 

z ^z', given that the Hamming distance d^z, z')=3. This value 
is the m inimum Euclidean distance of the inner TCM code 
due to input Hamming distance 3, denoted by h m ^ 3 \ 

3. Among the candidate encoders, select the one that has 50 

the largest minimum Euclidean distance in encoded 
sequences produced by input sequences with Hamming dis- 
tance . This minimum Euclidean distance of the SCTCM is 

called h m . 

It has been found by the inventors that that sequences with 55 
Hamming distances of 2 or 3 at the input of the TCM encoder 
are still important, even if the free Hamming distance d® of 
the outer code is larger than 2 or even 3. This is because the 
interleaving gain at low signal to noise ratios may depend on 
the number of error events that a pair of input sequences 60 
generate in the trellis of the inner code. For a given input 
Hamming distance, a larger number of error events may cre- 
ate a smaller interleaving gain. For example, if the input 
Hamming distance between sequences to the inner TCM is 4, 
the largest number of error events that produce small output 65 
Euclidean distances is 2 (two events with an input Hamming 
distance of 2 each). 


As described above, the present embodiments also use 
mapping of output labels for TCM. As soon as the input labels 
and output signals are assigned to the edges of a trellis, a 
complete description of the TCM code is obtained. The selec- 
tion of the mapping (output labels) does not change the trellis 
code. However, it influences the encoder circuit required to 
implement the TCM scheme. A convenient mapping should 
be selected to simplify the encoder circuit and, if possible, to 
yield a linear circuit that can be implemented with exclusive 
Ors. The set partitioning of the constellation and the assign- 
ment of constellation points to trellis edges, and the succes- 
sive assignments of input labels to the edges may be impor- 
tant. Ungerboeck proposed a mapping called “Mapping by set 
partitioning”, leading to the “natural mapping”. This map- 
ping for two-dimensional modulation may be useful if one 
selects the TCM scheme by searching among all encoder 
circuits that maximize the minimum Euclidean distance. 

The “inner” trellis code modulator can be configured as 
follows: 

The well known set partitioning techniques for signal sets 
may be used. 

The input label assignment is based on the codewords of 
the parity check code (m,m- 1 ,2) and the set partitioning, 
to maximize the quantities described in the equations 
above. The minimum Hamming distance between input 
labels for parallel transitions will be equal to 2. The 
assignment of codewords of the parity check code as 
input labels to the two-dimensional signal points is not 
arbitrary. 

A sufficient condition to have very large output Euclidean 
distances for input sequences with Hamming distance 1 
is that all input labels to each state be distinct. 

A pair of input labels and two-dimensional signal points 
are assigned to the edges of a trellis diagram based on the 
design criteria described above. 

Let the eight phases of 8PSK be denoted by {0, 1 , 2, 3, 4, 5, 
6, 7}. Here m=3. Consider the 8PSK signal set A={0, 2, 4, 6}, 
and set B={ 1 , 3, 5, 7} . For unit radius 8PSK constellation, the 
minimum intra-set square Euclidean distance for each set is 2. 
The minimum inter-set square Eucliden distances is 0.586. 

Select the input label set L 0 as codewords of the (3, 2, 2) 
parity check code, i.e. L o =[(000), (Oil), (101), (110)], next 
generate input label L^Lq+^OI), i.e., L^^OOl), (010), 
(100), (111)}. Consider a 2-state trellis. Assign the input- 
output pair (L 0 , A) to four edges from state 0 to state 0. Assign 
the input-output pair (L l5 B) to four edges from state 0 to state 
1. Next assign the input-output pair (L 2 , A) to four edges from 
the state 1 to state 0, and assign the input-output pair (L 3 , B) 
to four edges from-state 1 to state 1. L 2 has the same elements 
as in L : but with different order, and L 3 has the same elements 
as in L 0 again with different order. In order to maximize the 
minimum Euclidean distance due to the input sequences with 
Hamming distance 2, we have to find the right permutation 
within each set. In this case it turns out that using the comple- 
ment operation suffices. Therefore define input label L 2 as the 
complement of the elements of L 0 without changing the order, 
i.e., L 2 =[(l 11), (100), (010), (001)]. Finally L 3 is generated in 
the same way, as the complement of elements in L 1? i.e. 
L 3 =[(110), (101), (Oil), (000)]. 

Such assignment guarantees that the squared effective free 
Euclidean distance of trellis code is 2, where the minimum 
squared Euclidean distance of the code is 0.586. 

Having determined the code by its input labels and two- 
dimensional output signals, the encoder structure can then be 
obtained by selecting any appropriate labels (output labels) 
for the two-dimensional output signals. The following output 
mapping may be used: {(000), (001), (010), (Oil), (110), 
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(111), (100), (101)], mapped to phases [0, 1, 2, 3, 4, 5, 6, 7], 
which is called “reordered mapping”. For this 2-state inner 
code, d fef f=2, and h m (3) =oo, and h m 2 =0.586. The outer code 
for this example can be selected as a 4-state, rate 2/3, convo- 
lutional code with d / °=3 (this is a recursive systematic rate 1/2 
convolutional code where the parity bits are punctured). Since 
h m (3) =oo then d^° is increased effectively to 4. This method of 
design was used to obtain the encoders in the previous 
examples for 1 6QAM. 

A decoder is described herein. This decoder can be a Bit- 
by-Bit Iterative Decoder. The iterative decoder for serially 
concatenated trellis coded modulation uses a generalized 
Log-APP (a-posteriori probability) decoder module with four 
ports, called SISO APP module or simply SISO. The block 
diagram of the iterative decoder for serial concatenated TCM 
is shown in FIG. 9. The device has a SISO inner decoder 900 
coupled to a deinterleaver 905, an outer decoder 910. Feed- 
back is passed through an interleaver 920 back to the inner 
decoder. 

The decoding techniques may be used for the inner TCM 
code and outer convolutional code, using the trellis section 
shown in FIG. 10. Consider an inner TCM code with p : input 
bits and q x nonbinary complex output symbols with normal- 
ized unit power, and an outer code with p 2 input bits and q 2 
binary outputs {0.1 }. Let (e) represent u^-(e); i=l,2, . . . , 
p m the input bits on a trellis edge at time k (m=l for the inner 
TCM, and m=2 for the outer code), and let c k (e) represents 
c t z ( e ); i=l,2, . . . , q /Z7 the output symbols (m=l for the inner 
TCM, with nonbinary complex symbols, and m=2 for the 
outer code with binary {0, 1} symbols). 

Define the reliability of a bit Z taking values {0, 1 } at time 
k as 


A ] = log 


Pk\Z= 1;.] 
Pit [Z = 0;.] 


-continued 

AGO = max *\p k+ i[s E (e)] + 

^ e\s?{e)=s y 

Pi <71 3 

u k+i,i( e )^k+i P/t+i,;; d + ^ Ajt + i [c* + u(e); 0 f + hp k 

i= 1 /=1 J 

10 

for all states s, and k=l, . . . , (n -1), where n represents the 
total number of trellis steps from the initial state to the final 
state. 

15 The extrinsic bit information for U* ■; j=l,2 . . . , p l can be 
obtained from: 


A* (t/jt O ) = max * 

20 


a k -i [s s (e)] + ^ u k>i {e)X k [U k y, /] + ^ A* [c kri (e)\ /] + p k [>*(*?)] 


30 


max 

e:u k j(e)= 0 


Pi 

*< o-k- 1 l> s (f?)] + ^ Uk,\{e)\ [Uk,j\ /] + 
1=1 
i*j 


35 


91 

2 h [' Ck ,i (<?); /] + fit [s* (<?)] 


The second argument in the brackets, shown as a dot, may 
represent I, the input, or O, the output, to the SISO. We use the 
following identity 


where 

40 




I A,«(e); /] = - 




/ 2 - 


a 



= maxla;} + 6{ai, 


, at) = max *{«, } 


45 


where 6(a 1; . . . , a L ) is the correction term which can be 
computed using a look-up table. 

The “max” operation is a maximization (compare/select) 
plus a correction term (lookup table). Small degradations 
occur if the “max” operation is replaced by “max”. The 
received complex samples {Y^.} at the output of the receiver 
matched filter are normalized such that additive complex 
noise samples have unit variance per dimension. 

SISO can be used for the Inner TCM. 

The forward and the backward recursions are: 


a k ( 5 ) = 

{ pi q i _ ) 

a k -i [s s (e)] + ^ u kJ (e)A k [U kJ \ I] + J k [c k:i {e)\ I] j + h Qk 


We assume the initial and the final states of the inner encoder 
(as well as the outer encoder) are the all zero state. Forward 
recursions start with initial values, a o (s)=0, if s =0 (initial 
zero state) and a 0 (s)=-oo 5 if s^0. Backward recursions start 
with p w (s)=0, if s=0 (final zero state) and p w (s)=-oo, if s*0. 
The h 60 k and h pAr are normalization constants which, in the 
hardware implementation of the SISO, are used to prevent 
55 buffer overflow. These operations are similar to the Viterbi 
algorithm used in the forward and backward directions, 
except for a correction term that is added when compare- 
select operations are performed. At the first iteration, all 
MU*,;I] are zero. After the first iteration, the inner SISO 
60 accepts the extrinsics from the outer SISO, through the inter- 
laver jt, as reliabilities of input bits of TCM encoder, and the 
external observations from the channel. The inner SISO uses 
the input reliabilities and observations for the calculation of 
65 new extrinsics Z^(U^;0) for the input bits. These are then 
provided to the outer SISO module, through the deinterleaver 
jt -1 . The forward and the backward recursions for SISO are: 
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a k (^) = 


(pi <h \ 

max * \ a k _! [^ s (e)] + V u k>i (e) X k [U k f, /] + V A* [c kti (e)\ /] \ + h a 

eJ ( e)=s \ U tt ) 


*|/i 


fik F) — max * ^ fi k +i [/wn- 

e:5 J (e)=5 


91 1 

y^ i u k+l,i( e ^k+l [Uk+l,i\ I] + ^ A^+l [Ck+l,i( e )i I] f + h} 


The extrinsic information for C^-y=l,2 . . . , q 2 , can be 
obtained from: 


Xk(U k O) = max * 

e:u k j(e)= 1 


P 1 <?1 

a k - 1 [s* (e)] + Yj U u( e )*k Wk,i\ I] + Yj ^k[c k ,iie)\ /] + fi k [/( e )] ► - 

i=i i=i 

i*j i 


max 

e:u k j{e)= 0 


P 1 

* « a k -i [s s (<?)] + ^ u k ,i{e)\ k [u k ,j\ /] + 

i=i 

i*j 


91 

^ A ~ k [c k ,i{e)\ /] + p k [s E (e)] 


with initial values, a o (s)=0, if s=0 and cx 0 (s)=-oo, if s^O and 
p w (s)=0, if s=0 and p w (s)=-oo, if s^O, where h afc and hp^ are 
normalization constants which, in the hardware implementa- 
tion of the SI SO, are used to prevent the buffer overflow. 

The final decision is obtained from the bit reliability com- 
putation ofU^;j=l ,2, . . . , p 2 , passing through a hard limiter, 
as 


A k {U k j\0)= max * 

e:u k j[e)=l 


<*k - 1 [■**(«)] + ^ u k,i (e)X k [Uk,r, /] + ^ h [c k ,i{e)\ I] + Pk 


i=i 

i*j 


max 

e:u k j{e)= 0 


P 1 

* < a k -]_ [s s (<?)] + Yj u k ,i(e)A k [u k j, /] + 

i=i 

i*j 


^ X k [c k ,i(e); /] + p k [s E (e)] 


The outer SISO accepts the extrinsics from the imier SI SO as 
input reliabilities of coded bits of the outer encoder. For the 
outer SISO there is no external observation from the channel. 
The outer SISO uses the input reliabilites for calculation of 
5 new extrinsics ^(C^;0) for coded bits. These are then pro- 
vided to the inner SISO module. 

The structure of iterative decoder for punctured outer code 
is shown in FIG. 11. 

Other embodiments are within the disclosed invention, 
to What is claimed is: 

1 . A decoding apparatus configured to decode first symbols 
received from a channel, wherein the first symbols corre- 
spond to output symbols transmitted onto the channel by an 
encoder system, wherein the encoder system is configured to 

1 5 perform an outer encoding on source data in order to generate 
first data, and to perform an inner trellis coded modulation 
(TCM) on an interleaved version of the first data to generate 
the output symbols, the decoding apparatus comprising: 

an inner soft-input soft-output (SISO) module configured 
20 to compute first feedforward information based on input 
information and on first feedback information, wherein 
the input information is derived from the first symbols 
received from the encoder system, wherein the inner 
SISO module is configured to compute the first feedfor- 
25 ward information based on an inner trellis defined by 
said inner TCM of the encoder system; 

a fill and multiplex (FAM) unit configured to generate 
augmented information by interleaving zero bits with 
bits of a deinterleaved version of the first feedforward 
30 information; 

an outer SISO module configured to compute output infor- 
mation and second feedback information based on the 
augmented information, wherein the outer SISO module 
is configured to compute the output information and the 
35 second feedback information based on an outer trellis 
defined by the outer encoding of the encoding system; 
and 

a puncture and demultiplex (PAD) unit configured to punc- 
ture the second feedback information according to a 
40 puncturing pattern, in order to generate punctured feed- 

back information, wherein the first feedback informa- 
tion is an interleaved version of the punctured feedback 
information; 

wherein the inner TCM of the encoder system includes an 
45 inner encoding and a mapping, wherein the inner encod- 

ing encodes the interleaved version of the first data to 
generate intermediate data according to a rate 1 recur- 
sive code, wherein the mapping generates the output 
symbols of the inner TCM from the intermediate data 
50 according to a first map, wherein the rate 1 recursive 

code and the first map maximize the effective free 
Euclidean distance of the inner TCM. 

2. The decoding apparatus of claim 1, wherein the decod- 
ing apparatus is configured to generate an estimate of at least 

55 a portion of the source data from the output information. 

3. The decoding apparatus of claim 1, wherein the decod- 
ing apparatus is configured to operate said inner SISO module 
and said outer SISO module in an iterative fashion. 

4. The decoding apparatus of claim 1, wherein the output 
60 symbols are points in a quadrature amplitude modulation 

(QAM) constellation, wherein the number of points in said 
QAM constellation is equal to 2 2m , wherein m is an integer 
greater than one. 

5. The decoding apparatus of claim 1, wherein the output 
65 symbols correspond to a phase-shift keying (PSK) modula- 
tion, wherein the PSK modulation has a constellation with 2 m 
points, wherein m is larger than one. 
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6. The apparatus of claim 1, wherein the outer encoding is 
configured to maximize free Hamming distance. 

7. The apparatus of claim 6, wherein the free Hamming 
distance of the outer encoding is odd, wherein the rate 1 
recursive code and the first map are also selected to maximize 
Euclidean distance d(x(z), x(z')) over pairs z, z' given that the 
Hamming distance d^ZjZ 1 ) is equal to three, wherein z and z* 
are possible input sequences to the rate 1 recursive code. 

8. The apparatus of claim 1, wherein the inner trellis is a 
4-state trellis. 

9. The apparatus of claim 1, wherein the inner trellis is a 
2-state trellis. 

10. A decoding apparatus configured to decode first sym- 
bols received from a channel, wherein the first symbols cor- 
respond to output symbols transmitted onto the channel by an 
encoder system, wherein the encoder system is configured to 
perform an outer encoding on source data in order to generate 
first data, and to perform an inner trellis coded modulation 
(TCM) on an interleaved version of the first data to generate 
the output symbols, the decoding apparatus comprising: 

a first means for computing first feedforward information 
based on input information and on first feedback infor- 
mation, wherein the input information is derived from 
the first symbols received from the encoder system, 
wherein said computing the first feedforward informa- 
tion is based on an inner trellis defined by said inner 
TCM of the encoder system; 

a second means for generating augmented information by 
interleaving zero bits with bits of a deinterleaved version 
of the first feedforward information; 

a third means for computing output information and sec- 
ond feedback information based on the augmented 
information, wherein said computing the output infor- 
mation and the second feedback information is based on 
an outer trellis defined by the outer encoding of the 
encoding system; 

a fourth means for puncturing the second feedback infor- 
mation according to a puncturing pattern in order to 
generate punctured feedback information, wherein the 
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first feedback information is an interleaved version of 
the punctured feedback information; and 

wherein the inner TCM of the encoder system includes an 
inner encoding and a mapping, wherein the inner encod- 
5 ing encodes the interleaved version of the first data to 

generate intermediate data according to a rate 1 recur- 
sive code, wherein the mapping generates the output 
symbols of the inner TCM from the intermediate data 
according to a first map, wherein the rate 1 recursive 
10 code and the first map maximize the effective free 
Euclidean distance of the inner TCM. 

11. The decoding apparatus of claim 10, wherein the 
decoding apparatus is configured to generate an estimate of at 
least a portion of the source data from the output information. 
15 12. The decoding apparatus of claim 10, wherein the 

decoding apparatus is configured to operate said first means, 
said second means, said third means and said fourth means in 
an iterative fashion. 

13 . The decoding apparatus of claim 1 0, wherein the output 
20 symbols are points in a quadrature amplitude modulation 

(QAM) constellation, wherein the number of points in said 
QAM constellation is equal to 2 2m , wherein m is an integer 
greater than one. 

14. The decoding apparatus of claim 10, wherein the output 
25 symbols correspond to a phase-shift keying (PSK) modula- 
tion, wherein the PSK modulation has a constellation with 2 m 
points, wherein m is larger than one. 

15. The apparatus of claim 10, wherein the outer encoding 
is configured to maximize free Hamming distance. 

30 16. The apparatus of claim 15, wherein the free Hamming 

distance of the outer encoding is odd, wherein the rate 1 
recursive code and the first map are also selected to maximize 
Euclidean distance d(x(z), x(z')) over pairs z, z' given that the 
Hamming distance d^z,^) is equal to three, wherein z and z' 
35 are possible input sequences to the rate 1 recursive code. 

17. The apparatus of claim 10, wherein the inner trellis is a 
4-state trellis. 

18. The apparatus of claim 10, wherein the inner trellis is a 
2-state trellis. 



